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A Generalized Block-Edge 
Impairment Metric for Video Coding 

H. R. Wu and M. Yuen 



Abstract — A new generalized block-edge impairment metric 
(GBIM) is presented in this paper as a quantitative distortion 
measure for blocking artifacts in digital video and image coding. 
This distortion measure does not require the original image 
sequence as a comparative reference, and is found to be consistent 
with subjective evaluation. 

Index Terms — Blocking artifacts, quantitative impairment met- 
ric, video coding. 



I. INTRODUCTION 

FOR bit rates ranging from 64 kbps (ITU H.261) to as 
high as 10-12 Mbps (MPEG-2) [1], we have shown 
in [2] that blocking effects, and its propagation through 
reconstructed video sequences, are the most significant of 
all coding artifacts. The blocking effect is also a source of 
a number of other types of reconstruction artifacts, such as 
stationary area granular noise [3]. It is well known that many 
forms of quantitative quality metrics, or distortion measures, 
used in image and video coding research, such as mean squared 
error (MSE), peak signal-to-noise ratio (PSNR), and mean 
absolute error (MAE) [1], are ineffective in quantifying the 
visibility of reconstruction artifacts, and, therefore, are ill 
suited for evaluating image and video compression techniques 
and products. The reason for this relates to the fact that these 
measures do not necessarily reflect our visual perception of 
the coding distortions and artifacts found in reconstructed 
sequences. Consequently, there is a poor correlation between 
these metrics and subjective assessment [4]. 

Recently, Karunasekera and Kingsbury introduced a new 
distortion measure for blocking (edge) artifacts in compressed 
images based on human visual sensitivity [4], This quantitative 
distortion measure requires both the original and reconstructed 
images to form an error image, which is then used as an input 
into their visual model. This approach is similar to most of the 
other existing quantitative distortion measures [5], [6]. In the 
absence of the original image, the above distortion measures 
cannot be used to evaluate the quality of a reconstructed image 
or the presence of coding artifacts, such as the blocking effect. 



Manuscript received September 12, 1996. This work was supported in 
part by a 1995 Australian Research Council grant. The associate editor 
coordinating the review of this manuscript and approving it for publication 
was Prof. Rashid Ansari. 

The authors are with the Department of Digital Systems, Monash Univer- 
sity, Clayton 3 1 68 Australia (e-mail: hrw@rdt.monash.edu.au). 

Publisher Item Identifier S 1070-9908(97)08940-2. 



10' r 1 { 



10» 



■'I I I l 1 » 

O 50 tOO 150 200 2SO 300 

Lwwunca 

Fig. 1. The weighting function for the generalized BIM. 

In [2], the block-edge impairment metric (BIM) was intro- 
duced to evaluate the visual significance of block-edge artifacts 
in a given image. The BIM was based on a formulation 
of constraint sets applied successfully in the postfiltering of 
reconstructed video images using projections onto convex sets 
(POCS) algorithms [7]. Whilst achieving results consistent 
with subjective evaluations, this metric was characterized by 
the fact that it did not require the original image to produce a 
measure of the distortion in a reconstructed image. 

To take into account the luminance masking effects in 
extreme bright as well as extreme dark areas in a reconstructed 
image, a more general formulation of the BIM is presented in 
Section II of this contribution, parameters of which can be 
adjusted to correspond with the visibility of noise modeled 
in [8], Section III will present experimental results using this 
generalized BIM as a distortion measure compared with PSNR. 

II. A Generalized Block-Edge Impairment Metric 

In [8], Girod suggested that distortions are most noticeable 
where the luminance value is between 70 and 90 (centered 
approximately on 8 1 ) in 8-b grey-scale images. To accommo- 
date this observation, and to maintain the simplicity of the 
weighting function in the BIM, a generalized BIM (GBIM) is 
formulated as follows. 

Given an image f = {f cl f C 2 • • • £cN c }> where f CJ - is the jih 
column of the image array and N c is the width of the image, we 
define the interpixel difference between each of the horizontal 
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block boundaries (vertical edge artifacts) by 



D e f = 



fc8 - fc9 
fcl6 - fcl7 

fc(N c -S) ~ fc(AT e -7)- 



(1) 



where we assume 8 x 8-pel blocks, as commonly used in 
video coding standards. 

A metric can be defined to measure the horizontal blockiness 

by 



=|| WD c i || 



N e /8-l 

53 'I w *[ f c(8x*) - fc(8xfc+l)] II 2 
fe=l 



"I 



(2) 



where || - || is the I2 norm and W = 
diag[ wi, w 2 , • • • , w^/8-1 ] is a diagonal weighting 
matrix which takes into account the local spatial 
characteristics of a given image [7], [9]. Each 
Wfc = diag[ W\ t j, v)2 t j j • * • , WN r j ], where N r is the height 
of the image, and j = 8 x k for k = 1, 2, • • • , N c /S - 1. 
The weighting function for each block-edge pel difference 



is given by 



(3) 



otherwise 



at pel location (i, j), which accounts for the human visual 
system (HVS) masking of the block-edge artifacts in extreme 
bright and dark areas, as well as spatially busy areas, of an 
image [8]. In (3), £ is the selected average luminance value 
for which the highest weight should be given to the distortion, 
and A is calculated as 



A = 



ln(l + y/255 - 0 



(4) 



ln(l + v^) * 

The weighting function defined in (3) is shown in Fig. 1, 
assuming a» t y = 0 and £ = 81. 

For horizontal block boundaries, the local mean in (3) 
is based on the mean of the pels within the two adjoining 
blocks of the current row as follows: 

w.i = — 2 — 

where j and fi^j are the means of the pels within row i 
of the blocks to the left and right, respectively, of the current 
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Fig. 3. POCS filtered I picture reconstruction from MPEG-1 coded mobile and calendar video sequence (0.8 Mbps, IBBBPBBBP- - •). Mgbim = 105 
and PSNR = 21.86 dB. 



block boundary 

3 i+8 

n=j—7 n=j + l 

where /i >n represents an individual pel located at row i and 
column n of picture f. 

Similarly, the standard deviation in (3) is given by 

„ + 

2 

where and are the standard deviations of the pels 
within row i of the blocks to the left and right, respectively, 
of the block boundary 

1/2 

I £ (/«.»- MSi) 2 

n=j-7 



.A _ 



i+8 

n=j+l 



I 1 / 2 



A similar procedure is used for calculating the weights for 
vertical block boundaries, with the only difference being that 
consideration is taken of the statistical characteristics of the 



columns, instead of the rows, of the abutting blocks above 
and below any given block boundary. 

We further normalize Mh by the average interpixel dif- 
ference, E, between pels which are not at block boundaries, 
resulting in M^gbim = Mh/E. The formula to calculate E 
is defined as 

7 

£=±£s„ (5) 

n=l 

where 

-* c /8-l 1 1/2 
Sn = £ II W *[ f c(8xM-n) - fc(8xfc+n+l)] || 2 

(6) 

A metric M v gbim can be similarly defined to measure the 
blockiness across vertical block boundaries of reconstructed 
images. The generalized BIM for the analysis of image recon- 
struction quality is therefore given by 

Mgbim = « M^bim + P M vG bim • (7) 

The higher the Mgbim value is above one, the greater the 
severity of the blocking effect. The two parameters, A and £, 
in (3) can be adjusted to provide a better correlation between 
this metric and subjective assessment of the distortion. 
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TABLE I 

PSNR and A/qbim Values of Reconstructed I-Frames 
Before and After POCS Filtering for the Blocking Effect 





Bitrate 


Unfiltcrcd 


Filtered 


Sequence 


(Mbps) 


A^GBIM 


PSNR 




PSNR 


Claire 


0.4 


4.09 


36.46 


1.19 


37.30 




0.6 


2.24 


41.36 


1.24 


41.70 




0.8 


1.80 


45.26 


1.30 


45.29 


Flower 


0.4 


3.46 


21.31 


1.09 


21.49 


garden 


0.6 


2.34 


22.30 


1.10 


22.48 




0.8 


1.85 


23.85 


1.10 


24.04 


Football 


0.4 


2.91 


28.38 


1.03 


28.57 




0.6 


2.02 


30.02 


1.03 


30.18 




0.8 


1.71 


31.44 


1.03 


31.60 


Mobile & 


0.4 


4.42 


20.91 


1.06 


21.04 


calendar 


0.6 


3.61 


21.38 


1.05 


21.51 




0.8 


3.11 


21.75 


1.05 


21.86 


PRL car 


0.4 


4.06 


28.35 


1.06 


28.62 




0.6 


2.60 


30.45 


1.10 


30.69 




0.8 


2.17 


32.06 


1.12 


32.29 


Table- 


0.4 


2.68 


25.30 


1.06 


25.35 


tennis 


0.6 


1.90 


26.16 


1.04 


26.19 




0.8 


1.48 


27.31 


1.03 


27.33 



III. Simulation Results 

In our experiments, we used CIF-sized images (352 x 
288) and assumed that the human sensitivity to horizontal 
and vertical blocking artifacts are similar [4], and therefore 
selected a = (3 = 0.5 in (7). The subjective evaluation was 
conducted using an Abekas A65 Digital Disk Recorder with a 
Sony PVM-2130QM Color Video Monitor. 

A reconstructed I picture of the mobile and calendar se- 
quence (MPEG-1 coded at 0.8 Mbps) is shown with its 
Mgbim and PSNR values in Fig. 2, compared with a POCS 
filtered [9] reconstruction of the same picture, also shown with 
its Mgbim and PSNR values, in Fig. 3. These experiments 
demonstrate that the POCS filtering reduces the blocking 
artifacts significantly, and also shows that Mgbim is a very 
effective measure for blocking artifacts in terms of consistency 
with subjective evaluations. It is interesting to note that the 
reconstructed picture has M/»gbim = 3.29 and M v gbim = 
2.95, respectively, indicating that the horizontal blockiness 



(or vertical edge artifacts) is more prominent than the vertical 
blockiness (or horizontal edge artifacts). The POCS filtered 
reconstruction of the same picture has M^GBrM = M v gbim = 
1.05. The values obtained using Mgbim are found to be 
consistent with subjective evaluations. Similar results were 
also obtained for several other MPEG-1 coded sequences, 
at various bitrates. Table I provides a compilation of the 
PSNR and Mgbim values for these sequences. Due to space 
restrictions, the corresponding reconstructed images are not 
shown here. 

IV. Conclusions 

This letter introduced a generalized block-edge impairment 
metric that enables the evaluation of reconstructed picture 
quality without the need for the original images as comparative 
references. This work has shown that the evaluation of block- 
ing artifacts using this metric is very effective and consistent 
with subjective evaluation. 
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Description 

The present invention relates digital image coding. More precisely, the invention relates to a post-processing 
method for reducing artifacts in block-coded digital images, and to a post-processing device suitable for actuating such 
5 a method. 

With the diffusion of digital communication systems, digital images are more and more used. This has led to the 
diffusion of still and video cameras with digital acquisition and processing capability. 

In order to better exploit storage means and transmission bandwidth, digital image compression standards have 
been developed, such as JPEG for still images, and MPEG-1 and MPEG-2 for digital television image sequences. 
10 The above-referred compression standards provides for block-coding based on Discrete Cosine Transform (DOT). 
A digital image is divided into blocks of pixels, and each block is encoded independently from the others. OCT coeffi- 
cients for the pixels of each block are evaluated and a quantization matrix is applied to the DCT coefficients to reduce 
the information to be stored or transmitted. When the image is to be displayed, it must be decoded in advance. 

Due to the quantization process, these image compression methods are lossy, i.e. they cause a loss of information 
75 in the decoded image with respect to the original image. The decoded image can thus present noticeable degradation, 
mainly consisting of two kinds of artifacts known in the art under the names of "grid noise" and "staircase noise". 

In order to reduce the image degradation, post-processing methods of the decoded image have been proposed 
which allow for attenuating grid noise and staircase noise. 

In view of the state of the art described, it is an object of the present invention to provide a new post-processing 
20 method for reducing artifacts in block-coded digital images. 

According to the present invention, such object is attained by means of a post-processing method for reducing arti- 
facts in block-coded digital images, characterized by providing for: 

a) dividing an input image into a plurality of image blocks; 
25 b) for each image block, estimating global features of said image block providing information on an average content 
of image edges along the horizontal and vertical directions of said image block; 

c) for each pixel of an image block under examination, estimating local features for said pixel providing information 
on the content of image edges along the horizontal and vertical directions of an image area around said pixel; 

d) modifying the value of said pixel according to both said global features of the image block to which said pixel 
30 belongs and said local features of the image area around said pixel. 

Also according to the invention, there is also provided a post-processing device for actuating said method, charac- 
terized by comprising: 

35 - first means supplied with an input image for estimating global features of an image block under examination, said 
global features providing information on an average content of image edges along the horizontal and vertical direc- 
tions of said image block; 

second means supplied with said input image for estimating local features for each pixel of the image block under 
examination, said local features providing information on the content of image edges along the horizontal and ver- 
40 tical directions of an image area around said pixel; 

- third means supplied with said global features and said local features for modifying the value of said pixel according 
to both said global features and said local features. 

The features and advantages of the present invention will be made apparent from the following detailed description 
45 of an embodiment thereof, illustrated as a non-limiting example in the annexed drawings, wherein: 

Figure 1 is a schematic block diagram illustrating the principle of operation of a method according to the present 
invention; 

Figure 2 shows a digital image divided into image blocks; 
so Figure 3 shows in detail an image block into which the digital image of Figure 2 is divided; 
Figure 4 shows an array of pixels of the image block of Figure 3; 

Figure 5 shows an image sub-block of the image block of Figure 3 used for evaluating global features of the image 
block; 

Figure 6 shows an horizontal processing window used for evaluating local features in the horizontal direction for a 
55 generic pixel of the image block; 

Figure 7 shows a vertical processing window used for evaluating local features in the vertical direction for said 
generic pixel; 

Figures 8 and 9 shows two membership functions used to perform a fuzzy computation; 
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Figure 10 is a block diagram of a device according to the present invention; 
Figure 1 1 shows the structure of two blocks of the device of Figure 10; and 
Figure 12 is a block diagram of other two blocks of the device of Figure 10. 

With reference to Figure 1 , there is shown a block diagram illustrating the principle of operation of the post-process- 
ing method according to the present invention. An input decoded compressed digital image In is supplied to a Feature 
Extraction block FE. Block FE provides for analyzing the image to evaluate global and local features thereof. The global 
and local features, respectively QF and LF, of the image In evaluated by block FE are supplied as inputs to a Fuzzy 
Process block FUZZY which, according to fuzzy rules, determines parameters FA suitable for determining the kind of 
filtering to be performed, in accordance to the global and local features GF and FL of the image. The parameters FA 
calculated by block FUZZY are supplied to a Filter Composition block FC which according to said parameters FA deter- 
mines the type of filtering to performed out of a set of predefined filters (block FS). Filter parameters FP determined by 
block FC are then supplied to a Processing block PROC, also supplied directly with the input image In, which performs 
the filtering of the input image In according to the filter parameters FP to provide a post-processed output image Out. 

It appears that the kind of filtering to be performed on the decoded input image In is chosen after an estimation of 
the global and local features of the decoded input image. For image areas near grid noise and near an edge, a low-pass 
filtering is performed, to reduce both staircase noise and grid noise. For areas containing fine details (image edges and 
texture), no filtering is performed. Thus, the method according to the present invention provides for performing a non- 
linear adaptive filtering on the pixels of the decoded image. 

The principle of operation outlined above will be now described in detail. 

As shown in Figure 2. the input image In is partitioned into image blocks IB, each containing an equal number of 
pixels. A typical dimension of the blocks is 8*8 pixels (Figure 3). but this is not however to be intended as a limitation, 
since other block dimensions are suitable. 

The image blocks IB of the input image In are scanned line by line starting from the top-left block to the bottom-right 
one. For each image block IB, the Feature Extraction block FE in Figure 1 determines the global and local features GF 
and LF. 

Global features of the image block IB under examination are determined by applying horizontal and vertical Sobel 
operators: 



horizontal Sobel operator (Hsob): 



vertical Sobel operator (Vsob) : 



rh11 h12 h13"| 
h21 h22 h33 
h31 h32 h33j 

V1 1 v12 v13l 
v21 v22 v23 
_v31 v32 v33J 



to each pixel belonging to an image sub-block internal to the image block IB. For example, the following Sobel opera- 
tors: 



Hsob: 



-1 0 r 

-2 0 2 
-1 0 1. 



Vsob: 



r-1 -2 -1 

0 0 0 

1 2 1 



are applied to a 6*6 pixel image sub-block ISB (gray area in Figure 5). As shown in Figure 4. for each pixel Pi of the 
image sub-block ISB a 3*3 array of neighboring pixels M centered in pixel Pi is considered, and the values of the pixels 
of said array M are multiplied by the coefficients of the horizontal and vertical Sobel operators, to obtain: 



Hsob = (P3+P8+2*P5) - (P1+P6+2T4), 
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Vsob = (P6+P8+2*P7) - (P1+P3+2*P2), 

where P1-P4 and P5-P8 are the values of the pixels (gray levels). 

As known, horizontal and vertical Sobel operators perform a filtering capable of detecting edges along the horizon- 

5 tal and vertical direction, respectively. 

The output values of the horizontal Sobel operators calculated for the pixels of image sub-block iSB are accumu- 
lated to obtain an accumulated value Acc(Hsob), and the output values of the vertical Sobel operators calculated for the 
pixels of image sub-block ISB are accumulated to obtain an accumulated value Acc(Vsob). Acc(Hsob) gives the high- 
frequency content in the horizontal direction (vertical edges) of the image block IB. Acc(Vsob) gives the high-frequency 

jo content in the vertical direction (horizontal edges) of image block IB. Thus, Acc(Hsob) and Acc(Vsob) respectively pro- 
vide the degree of "edgeness" of the image block under examination in the vertical and horizontal directions. It is to be 
noted that in order to evaluate the global features GF of the image block IB under examination, only the pixels belonging 
to this block are considered (by applying 3*3 Sobel operators to the 6*6 image sub-block ISB, it is not necessary to take 
into consideration pixels belonging to neighboring image blocks). 

15 Global features GF of the image block under examination can be formed by the accumulated values Acc(Hsob) and 
Acc(Vsob). Alternatively, the global features GF of the image block can be formed by an average of the accumulated 
values Acc(Hsob) and Acc(Vsob), to obtain the average number of edges in the horizontal and vertical directions in the 
image block under examination. 

Local features LF of the image block IB are estimated according to the following method. All the pixels of the image 

20 block IB under examination are scanned line by line starting from the top-left pixel down to the bottom-right one. To each 
pixel a horizontal processing window is applied: a prescribed number of pixels respectively preceding and following the 
pixel under consideration and belonging to the same image line of the pixel under consideration is considered. A suita- 
ble horizontal processing window HPW is shown in Figure 6. which is a horizontal 1 *5 processing window: for a given 
pixel, the two preceding pixels Pa, Pb and the two following pixels Pc, Pd belonging to the same line are considered. In 

25 Figure 6 there is shown by way of example the horizontal processing window HPW associated to the first pixel Px of the 
image block. K should be noted that not only the pixels of the image block IB under examination are considered, but also 
pixels belonging to neighboring image blocks; this is for example the case of the first, second, seventh and eight pixel 
of each line of pixels of the image block IB under examination. 

The horizontal Sobel operator Hsob previously mentioned is applied to each pixel Pa, Pb, Px, Pc. Pd in the horizon- 

30 tal processing window HPW, to obtain five output values HS1-HS5. Values HS1 -HS5 provide the local features in the 
horizontal direction for the pixel under examination Px, i.e. the high-frequency content in the horizontal direction of the 
image region around the pixel under examination. 

Similarly, a vertical processing window is applied to each pixel of the image block IB. The vertical processing win- 
dow is formed by the pixel under consideration Px, and a prescribed number of pixels belonging to the same column as 

35 and preceding and following the pixel under consideration; for example, as shown in Figure 7 the vertical processing 
window VPW can have dimensions identical to the horizontal processing window HPW (5*1 ), and thus contains two pix- 
els Pe, Pf preceding pixel Px and two pixels Pg, Ph following pixel Px in the vertical direction. 

The vertical Sobel operator Vsob previously mentioned is then applied to each pixel of the vertical processing win- 
dow VPW to obtain five output values VS1 -VS5. Values VS1 - VS5 form the local features in the vertical direction for the 

40 pixel under examination, i.e. the high-frequency content in the vertical direction of an image region around the pixel 
under examination. 

The global features GF for the image block IB under examination (i.e.. the two accumulated values Acc(Hsob) and 
Acc(Vsob) or, in alternative, the average value of Acc(Hsob) and Acc(Vsob)) and the local features LF for the pixel 
under examination inside said image block (the ten values HS1-HS5 and VS1-VS5) are then supplied to the Fuzzy 

45 Process block FUZZY. This block provides for evaluating the degree of membership of a generic value HSi and Vsi 
(i=1 ..5) to two fuzzy sets "Small" and "Big"; these degree of membership can be evaluated by applying to HSi, VSi the 
membership functions depicted in Figures 8 and 9. In these figures, Th1 and Th2 are values depending on the global 
features GF of the image block under examination, i.e. on the accumulated values Acc(Hsob) and Acc(Vsob) or on the 
average of the accumulated values; in the first case, Th1 and Th2 are different for the Hsi and Vsi values; in the second 

so case, Th1 and Th2 are the same for Hsi and Vsi values. 

Fuzzy rules having as antecedents the degrees of membership of the output values HSi and VSi to the two fuzzy 
sets "Small" and "Big" are then evaluated. This means that 32 rules are to be evaluated for both the horizontal and ver- 
tical directions. However, all those fuzzy rules having the same consequence are synthesized in one rule only by an else 
operator. In this way, the system complexity is reduced, and a total of nine rules for each direction have to be evaluated. 

55 The following fuzzy rules are applied to the five values HS1 -HS5 associated to the horizontal direction: 

1. //HS1 is Small andHS2 is Small andHSQ is Small andHSA is Small andHSS is Small, then a1 is Big; 

2. lfH$^ is Small andH$2 is Small andHSQ is Small andHS4 is Small andHSS is Big, then o2 is Big; 
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3. // HS1 is Small and HS2 is Small and HS3 is Small and HS4 is Big and HSS is Small, f/?en a3 is Big; 

4. /f HS1 is Small andHS2 is Small and HS3 is Small andHS* is Big and HS5 is Big, fften a4 /s Big; 

5. /f HS1 /s Small andHS2 is Big andHSQ is Small andHS* is Small andHSS is Small, tten a5 /s Big; 

6. //HS1 /s Big andHS2 is Small andHSS is Small andHS* is Small andHSS is Small. tf?en a6 as Big; 
5 7. // HS1 /s Big and HS2 /s Small and HS3 is Small and HS4 /s Small and HS5 is Big, then al is Big; 

8. //HS1 /s Big and HS2 /s Big and tf S3 /s Small andH$4 is Small andHSS is Small, ften a8 is Big. 

The activation level of each rule depends on the degree of memberships of the pattern of output values HSi of the 
horizontal Sobel operator applied to the five pixels of the horizontal processing window HPW; the degree of member- 
10 ships depend in turn on the global features GF of the image block to which the pixel under examination belongs. The 
activation level of the else (ninth) rule is computed as aelse = (1 - aave) , where aave is the average activation degree 
of fuzzy rules 1 to 8. a1 to a8 and aelse, and a similar set of nine activation degrees for the fuzzy rules applied to values 
VS1 -VS5) form the output FA of the fuzzy process block FUZZY in Figure 1 . 

Each one of the above-listed rules is associated to a respective set of predefined filter parameters, which are stored 
is as a look-up table in block FS of Figure 1 . Suitable predefined filter parameter sets are for example: 

Rule 1: (d 1=1.0. c12=1.0, c13=1.0. c14=1.0, c15=1.0) if the pixel under examination lies outside the image sub- 
block ISB, and (c11=0.0. c12=1.0, c13=1.0. c14=1.0. c15=0.0) if the pixel under examination lies inside the image 
sub-block ISB; 

20 Rule 2: (c21=0.5. c22=1.0, c23=1.0, c24=1.0, c25=0.0); 

Rule 3: (c31=0.5. c32=1.0. c33=1.0, c34=0.0, c35=0.0); 

Rule 4: (c41=0.5, c42=1.0, c43=1.0, c44=0.0, c45=0.0); 

Rule 5: (c51=0.0, c52=0.0, c53=1.0. c54=1.0, c55=0.5); 

Rule 6: (c61=0.0. c62=1.0, c63=1.0, c64=1.0, c65=0.5); 
25 Rule 7: (c71=0.0, c72=1.0, c73=1.0, c74=1.0. c75=0.0); 

Rule 8: (c81=0.0, c82=0.0, c83=1.0, c84=1.0, c85=0.5); 

Else rule: (c91=0.0, c92=0.0, c93=1 .0, c94=0.0, c95=0.0). 

The parameters FP of the filter to be applied to the five pixels of the horizontal processing window HPW are calcu- 
30 lated as a weighted average of the nine filters described above, with weight factors formed by the activation degrees <x1 
to a8 and aelse of the respective fuzzy rules. 

Assuming that ai is the activation degree of the i-th fuzzy rule (i=1 ..9), the ninth fuzzy rule being the else fuzzy rule 
(a9 = aelse ), and cij are the coefficients of the i-th filter (i=1 ..9, j=1 ..5), the weight factor applied to the i-th fitter, asso- 
ciated to the i-th fuzzy rule is: 



35 



40 



45 



50 



Fi = ai • cij 

and the coefficients Hj of the final horizontal filter to be applied to the pixels of the horizontal processing window HPW 
are given by: 

9 

£ai*cij 

where N is a normalization factor. 

The horizontally-filtered value Ex of the pixel Px under examination (at the center of the horizontal processing win- 
dow) is then calculated as a weighted average of the values of the pixels Pa. Pb. Px, Pc and Pd belonging to the hori- 
zontal processing window HPW, with weight factors formed by the coefficients Hj: 

Px = H1*Pa+ H2*Pb+ H3*Px+ H4*Pc+ H5*Pd. 



Similar calculations are performed for the vertical direction, starting from the output values VS1 -VS5 of the vertical 
Sobel operators applied to the pixels Pe. Pf. Px, Pg and Ph in the vertical processing window VPW. The coefficients Vj 
55 (j=1 ..5) of the filter for the vertical direction are calculated in a way completely similar to that used for determining the 
coefficients Hj: 
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9 

E Pi-cij 



where pi (i=1 ..9) are the activation degrees of nine fuzzy rules for the vertical direction (similar to those fisted above for 
the horizontal direction) and cij 0=1 ..5) now are the predefined filter parameters associated to the i-th Vu2zy rule for the 
vertical direction. The coefficients Vj are then applied to the pixels in the vertical processing window VPW to calculate 
a weighted average of the same. The filtered value of the pixel Px under examination, filtered in both tho horizontal and 
10 vertical direction, is provided at the output Out of the processing block PROC. 

The value of the pixel Px under examination to be multiplied by the vertical filter coefficient V3 can be the value Px. 
obtained after having applied to the pixels in the horizontal processing window HPW the horizontal filter Hj (j=1 ..5): 

Out = V1*Pe + V2*Pf + V3*Px + V4*Pg + V5*Ph. 

15 

Alternatively, it is possible to evaluate first the vertically-filtered value Ex of the pixel under examination: 

Px = V1 *Pe + V2*Pf + V3*Px + V4*Pg + V5*Ph, 

20 and then performing the filtering in the horizontal direction applying to this value the respective coefficient H3 of the hor- 
izontal filter Hj: 



Out = H1 *Pa + H2*Pb + H3*Px + H4*Pc + H5*Pd. 

25 The sequence is of no importance, the important thing to be underlined being that at the end of the process the value 
of the pixel under examination is the result of both an horizontal and a vertical filtering. 

Figure 10 is a block diagram of a device suitable for actuating the method previously described. The device com- 
prises two main blocks: a first block 1 evaluates the global features GF of the image blocks IB the image to be post- 
processed is divided in, and a second block 2 evaluates the local features LP of the pixels of the image and performs 

30 the filtering according to both the global features and the local features. 

It is assumed that the image to be post-processed is scanned line by line in a sequential order. Signal In is a stream 
of pixels of the input image scanned line by line. Block 1 is supplied with signal In; signal In also supplies a cascade of 
two line memories LM1 and LM2 whose outputs supplies block 1 . 

Inside block 1 , signal In and the outputs of line memories LM1 and LM2 supply a block 3 of pixel delays suitable for 

35 implementing a 3*3 pixel window which is used to calculate horizontal and vertical Sobel operators for the pixels of the 
6*6 image sub-block ISB inside each image block IB. Block 3 supplies a block 4 which calculates the outputs Hsob and 
Vsob of the horizontal and vertical Sobel operators for those pixels of the current image line belonging to the 6*6 image 
sub-blocks ISB of each image block IB. The outputs Hsob and Vsob of block 4 are supplied to an accumulator block 5 
wherein they are accumulated. After eight image lines, i.e. a line of image blocks IB, have been scanned, the accumu- 

40 lated values Acc(Hsob), Acc(Vsob) (or alternatively the average thereof) for each image block IB are stored in a mem- 
ory block 6. 

The output of line memory LM2 supplies a cascade of eight further line memories LM3-LM10. Block 2 is supplied 
in parallel with the outputs of line memories LM4-LM10. In this way, evaluation of the local features and calculation of 
the filter parameters starts after block 1 has estimated the global features GF for a line of image blocks IB. 

45 Inside block 2, a block 7 of pixel delays is supplied with the outputs of line memories LM4-LM10; by means of the 
line memories LM4-LM10 and the pixel delay block 7 it is possibile to implement the 5*1 vertical processing window 
VPW. The outputs L4-L10 of the pixel delays block 7 supply a block 8 which applies the vertical Sobel operator to each 
pixel inside the vertical processing window VPW. To avoid the use of further line memories, a parallel approach is pre- 
ferred providing for calculating five vertical Sobel operators in parallel; the outputs of the five vertical Sobel operators 

so VS1 -VS5 are supplied to a vertical fuzzy filter 9, which is also supplied with the outputs L6-L1 0 of the pixel delay block 
7 and the output MOUT of the memory MEM of block 1 . MOUT supplies the global features GF of the image block IB 
currently processed by block 2, i.e. the accumulated value Acc(Vsob) or, alternatively, the average of Acc(Vsob) and 
Acc(Hsob). The vertical fuzzy filter block 9 evaluates the degree of membership of values VS1 -VS5 to the fuzzy sets 
"Small" and "Big" taking into account the global features provided by MOUT, evaluates the activation levels of the nine 

55 fuzzy rules for the vertical direction, calculates the coefficients Vj Q=1 ..5) of the vertical filter and applies the vertical filter 
coefficients Vj to the five pixels Pe, Pf, Px, Pg, Ph in the vertical processing window VPW, to calculate the vertically- 
filtered value Ea of the pixel in the middle of the vertical processing window. The output of the vertical fuzzy filter block 
9 forms the vertically-filtered value Ed of pixel Pd in the horizontal processing window HPW shown in Figure 6 and sup- 
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plies directly a horizontal fuzzy filter block 10; the output Ed of block 9 also supplies a cascade of four pixel delays D 
whose outputs respectively form the vertically-f iltered values Pc. Px gb, Paof the pixels Pc, Px, Pb, Pa in the horizontal 
processing window HPW and supply the horizontal fuzzy filter block 10. 

In parallel to blocks 8 and 9, the outputs L7-L9 of the pixel delay block 7 supply a block 1 1 which applies the hori- 

5 zontal Sobel operators to the pixels inside the horizontal processing window HPW. Differently from the vertical sobel 
operators, only one horizontal sobel operator is calculated at a time; a compensation delay block 12 introduces a delay 
for compensating the processing delay of the vertical fuzzy filter block 9. The output of block 12, forming the output of 
the horizontal Sobel operator HS5 applied to pixel Pd of the horizontal processing window in Figure 6, supplies the hor- 
izontal fuzzy filter block 1 0 and a cascade of four pixel delays D, the outputs thereof forming the values HS4, HS3, HS2 

10 and HS1 and suppling the horizontal fuzzy filter block 1 0. The horizontal fuzzy filter block 1 0, which is also supplied by 
the output MOUT of the memory block MEM in block 1 providing the value Acc(Hsob) (or alternatively the average of 
values Acc(Hsob) and Acc(Vsob)). evaluates the degree of membership of values HS1-HS5 to the fuzzy sets "Small" 
and "Big" according to the value of the global features GF provided by MOUT, evaluates the activation levels of the nine 
fuzzy rules described above for the filtering in the horizontal direction, calculates the coefficients Hj of the horizontal ffl- 

w ter and applies the parameters Hj to the vertically-filtered values E§, Efc Eg, Eg, Ed of the pixels Pa. Pb. Px, Pc, Pd in 
the horizontal processing window HPW to obtain the horizontally- and vertically-filtered value Out of the pixel Px under 
examination. 

A control circuit CTRL controls the operation of blocks 1 , 2 and the line memories LM1-LM10. 
Figure 1 1 shows the structure of the vertical and horizontal Sobel operator blocks 8 and 1 1 of Figure 10. Ttiey are 
20 composed in a straightforward way by adders. 

Figure 12 shows the structure of both the vertical fuzzy filter block 9 and the horizontal fuzzy filter block 10. X1 -X5 
are the vertical or, respectively, horizontal Sobel operator outputs VS1-VS5 and HS1-HS5. X1-X5 are supplied to a 
fuzzy rule evaluation block 1 3 which evaluates the activation degrees p1 -p9 of the nine fuzzy rules for the vertical direc- 
tion or, respectively, the activation degrees a1-a9 of the nine fuzzy rules for the horizontal direction. The activation 
25 degrees evaluated by block 1 3 are supplied to a look-up table of respective predefined filter parameters F1 -F9 (forming 
block FS in Figure 1), and the outputs of the look-up table, i.e. the predefined filter parameters cij multiplied by the acti- 
vation degree of the respective fuzzy rule, are supplied to a filter composition block 1 4 which calculates the coefficients 
V1-V5 or, respectively, H1-H5, of the vertical or, respectively, horizontal filter. Said coefficients are then supplied to a 
processing block 15 which is also supplied with the pixel values PXS (L6-L10 or, respectively, E|, E&, Ex, Eg, Ed in Fig- 
30 ure 10); block 15 applies the filter coefficients to the pixel values to obtain the filtered value of the pixel under examina- 
tion Px. 

Claims 

35 1 . Post-processing method for reducing artifacts in block-coded digital images, characterized by providing for: 

a) dividing an input image (In) into a plurality of image blocks (IB); 

b) for each image block (IB), estimating global features (GF) of said image block providing information on an 
average content of image edges along the horizontal and vertical directions of said image block (IB); 

40 c) for each pixel (Px) of an image block (IB) under examination, estimating local features (LP) for said pixel (Px) 

providing information on the content of image edges along the horizontal and vertical directions of an image 
area near said pixel (Px); 

d) modifying the value of said pixel (Px) according to both said global features (GF) of the image block (IB) to 
which said pixel (Px) belongs and said local features (LF) of the image area near said pixel (Px). 

45 

2. Method according to claim 1 , characterized in that step d) provides for: 

d1) defining a set of predefined local features; 

d2) determining degrees of coincidence (a1 -a9,pi -p9)of said local features (LF) of the image area around said 
so pixel (Px) with each predefined local features of said set, said degrees of coincidence (a1-a9,pi -p9) depend- 

ing on said global features (GF) of the image block (IB) to which said pixel (Px) belongs; 
d3) making the value of said pixel (Px) equal to a weighted average (Px.Px) of the value of said pixel (Px) and 
of the values of neighboring pixels (Pa-Pd,Pe-Pf), with weight factors (H1-H5.V1-V5) depending on said 
degrees of coincidence of said local features (LF) with each of said predefined local features. 

55 

3. Method according to claim 2, characterized in that said determining the degrees of coincidence (<z1-a9.pi-p9) in 
step d2) provides for performing a fuzzy calculation. 
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4. Method according to claim 3, characterized in that each of said predefined local features is associated to a respec- 
tive group of predefined weight factors (cij), and each of said weight factors (H1-H5.V1-V5) is calculated as a 
weighted average of corresponding predefined weight factors (cij) of said groups with weight coefficients (a1- 
a9.pi-p9) depending on said degrees of coincidence of said local features (LF) with each of said predefined local 
features. 

5. Method according to claim 4, characterized in that said estimating global features (GF) of the image block (IB) 
under examination provides for applying horizontal and vertical Sobel operators (Hsob, Vsob) to pixels belonging to 
an image sub-block (ISB) internal to said image block (IB) under examination. 

6. Method according to claim 5. characterized in that said estimating global features (GF) of the image block (IB) 
under examination provides for adding outputs of the horizontal Sobel operators (Hsob) applied to each pixel of 
said image sub-block (ISB) to obtain an accumulated output of horizontal Sobel operators (Acc(Hsob)), and adding 
outputs of the vertical Sobel operators (Vsob) applied to each pixel of said image sub-block (ISB) to obtain an accu- 
mulated output of vertical Sobel operators (Acc(Vsob)). 

7. Method according to claim 6, characterized in that said global features (GF) of the image block (IB) under exami- 
nation are formed by said accumulated outputs of the horizontal and vertical Sobel operators 
(Acc(Hsob).Acc(Vsob)). 

8. Method according to claim 6. characterized in that said global features (GF) of the image block (IB) under exami- 
nation are formed by an average of said accumulated outputs of the horizontal and vertical Sobel operators 
(Acc(Hsob).Acc(Vsob)). 

9. Method according to claim 7 or 8, characterized in that said estimating local features (LF) for a pixel (Px) of the 
image block (IB) under examination provides for: 

d) considering an horizontal processing window (HPW) containing the pixel (Px) under examination and 
neighboring pixels (Pa,Pb.Pc,Pd) belonging to a same image line as the pixel (Px) and preceding and following 
the pixel (Px); 

c2) applying said horizontal Sobel operator (Hsob) to each pixel (Pa-Pd,Px) of the horizontal processing win- 
dow (HPW) to obtain a horizontal pattern of horizontal Sobel operator outputs (HS1-HS5); 
c3) considering a vertical processing window (VPW) containing the pixel (Px) under examination and neighbor- 
ing pixels (Pe,Pf,Pg.Ph) belonging to a same column of pixels as the pixel (Px) and preceding and following the 
pixel (Px); 

c4) applying said vertical Sobel operator (Vsob) to each pixel (Pe-Ph,Px) of the vertical processing window 
(VPW) to obtain a vertical pattern of vertical Sobel operator outputs (VS1-VS5). 

10. Method according to claim 9. characterized in that said horizontal and vertical processing windows (HPW, VPW) 
contains each one five pixels and are centered at said pixel (Px) under examination. 

11. Method according to claim 10, characterized in that step 62) provides for determining degrees of membership of 
each horizontal Sobel operator output (HS1-HS5) of the horizontal pattern to a first fuzzy set "Small" and to a first 
fuzzy set "Big", evaluating activation degrees (a1 -a9) of a first set of fuzzy rules each one associated with at least 
one predefined horizontal pattern of horizontal Sobel operator outputs, determining degrees of membership of 
each vertical Sobel operator output (VS1 -VS5) of the vertical pattern to a second fuzzy set "Small" and to a second 
fuzzy set "Big" and evaluating activation degrees (pi -p9) of a second set of fuzzy rules each one associated with 
at least one predefined vertical pattern of vertical Sobel operator outputs. 

12. Method aocording to claim 11, characterized in that said determining degrees of membership of the horizontal 
Sobel operator outputs (HS1-HS5) of the horizontal pattern to said first fuzzy sets "Small" and "Big" provides for 
determining a first and a second membership functions depending on said global features (GF), and said determin- 
ing degrees of membership of the vertical Sobel operator outputs (VS1 -VS5) of the vertical pattern to said second 
fuzzy sets "Small" and "Big" provides for determining a third and fourth membership functions depending on said 
global features (GF). 

13. Method according to claim 12, characterized in that said groups of predefined weight factors (cij) comprise groups 
of predefined horizontal weight factors and groups of predefined vertical weight factors, each fuzzy rule of said first 
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set being associated with a respective one of said groups of predefined horizontal weight factors, and each fuzzy 
rule of said second set being associated with a respective one of said groups of predefined vertical weight factors. 

14. Method according to claim 13, characterized in that said weight factors (H1 -H5.V1 -V5) comprise horizontal weight 
factors (H1-H5) and vertical weight factors (V1-V5). said horizontal weight factors (H1-H5) being determined by 
making a weighted average of the predefined horizontal weight factors with weight coefficients being formed by the 
activation degrees (<x1-a9) of the fuzzy rules of the first set, and said vertical weight factors (V1-V5) being deter- 
mined by making a weighted average of the predefined vertical weight factors with weight coefficients formed by 
the activation degrees (p1 -p9) of the fuzzy rules of the second set. 

15. Method according to claim 14, characterized in that the value of the pixel (Px) under examination is modified by 
applying the horizontal weight factors (H1-H5) to the values of the pixels (Pa-Pd.Px) in the horizontal processing 
window (HPW) and applying the vertical weight factors (V1 -V5) to the values of the pixels (Pe-Ph.Px) in the vertical 
processing window (VPW). 

16. Post-processing device for reducing artifacts in block-coded digital images, characterized by comprising: 

first means (1) supplied with an input image (In) for estimating global features (MOUT) of an image block (IB) 
under examination, said global features providing information on an average content of image edges along the 
horizontal and vertical directions of said image block (IB); 

- second means (7,8, 1 1 ,12,D) supplied with said input image (In) for estimating local features (VS1 -VS5.HS1 - 
HS5) for each pixel (Px) of the image block (IB) under examination, said local features providing information on 
the content of image edges along the horizontal and vertical directions of an image area around said pixel (Px); 

- third means (9.D.10) supplied with said global features (MOUT) and said local features (VS1 -VS5.HS1 -HS5) 
for modifying the value of said pixel (Px) according to both said global features (MOUT) and said local features 
(VS1-VS5.HS1 -HS5). 

17. Device according to claim 16. characterized in that said first means (1) comprises means (3.4) for evaluating hori- 
zontal and vertical Sobel operator outputs (Hsob, Vsob) of horizontal and vertical Sobel operators applied to pixels 
of an image sub-block (ISB) internal to said image block (IB) under examination, and accumulator means (5) for 
accumulating the horizontal Sobel operator outputs (Hsob) and the vertical Sobel operator outputs (Vsob) for each 
pixel of the image sub-block (ISB). 

1 8. Device according to claim 1 7, characterized in that said second means (7,8, 11 , 1 2,D) comprises fourth means (7,8) 
for evaluating vertical Sobel operator outputs (VS1-VS5) of vertical Sobel operators (Vsob) applied to said pixel 
(Px) and to vertically-neighboring pixels (Pe,Pf,Pg,Ph) preceding and following the pixel (Px) in the vertical direc- 
tion, and fifth means (11.12.D) for evaluating horizontal Sobel operator outputs (HS1-HS5) of horizontal Sobel 
operators (Hsob) applied to said pixel (Px) and to horizontally-neighboring pixels (Pa,Pb,Pc t Pd) preceding and fol- 
lowing the pixel (Px) in the horizontal direction. 

19. Device according to claim 18, characterized in that said third means (9.D.10) comprises vertical fitter means (9.D) 
supplied with said vertical Sobel operator outputs (VS1-VS5) and said global features (MOUT) for calculating a ver- 
tically-filtered value (E24 of said pixel (Px) depending on said global features (MOUT), said vertical Sobel operator 
outputs (VS1-VS5) and the values of said vertically-neighboring pixels (Pe,Pf,Pg,Ph), and horizontal filter means 
(10) supplied with said global features (MOUT), said horizontal Sobel operator outputs (HS1-HS5) and said verti- 
cally-filtered value (gjg of said pixel (Px) for calculating a horizontally-filtered value of said pixel (Px) depending on 
said global features (MOUT), said horizontal Sobel operator outputs (HS1-HS5) and the vertically-filtered values 
(^.Eb.Eg.Eg.Ed) of said pixel (Px) and said horizontally-neighboring pixels (Pa.Pb,Pc.Pd). 

20. Device according to claim 1 9, characterized in that said vertical filter means (9.D) comprises first fuzzy computation 
means (1 3) supplied with said vertical Sobel operator outputs (VS1 - VS5) and said global features (MOUT) for eval- 
uating degrees of coincidence (pi -p9) of the pattern of vertical Sobel operator outputs (VS1-VS5) with a set of pre- 
defined patterns of vertical Sobel operator outputs, said degrees of coincidence (P1-P9) depending on said global 
features (MOUT). a look-up table of predefined vertical filter coefficients (F1-F9) each one associated to at least 
one respective predefined pattern of vertical Sobel operator outputs, a vertical filter coefficients composition means 
( 1 4) supplied with said predefined vertical filter coefficients for generating a set of vertical filter coefficients (V1 -V5) 
which are a weighted average of the predefined vertical filter coefficients with weight coefficients formed by said 
degrees of coincidence (P1-p9), and a vertical filter (15) supplied with said vertical filter coefficients (V1-V5) and 
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the values of the pixel (Px) and the vertically-neighboring pixels (Pe.Pf.Pg.Ph) for providing at an ouput (FOUT) said 
vertically-filtered value of the pixel (Px). 

21. Device according to claim 20, characterized in that said horizontal filter means (10) comprises second fuzzy com- 
putation means (13) supplied with said horizontal Sobel operator outputs (HS1-HS5) and said global features 
(MOUT) for evaluating degrees of coincidence (a1-a9) of the pattern of horizontal Sobel operator outputs (HS1- 
HS5) with a set of predefined patterns of horizontal Sobel operator outputs, said degrees of coincidence (a1-a9) 
depending on said global features (MOUT), a look-up table of predefined horizontal filter coefficients (F1 -F9) each 
one associated to at least one respective predefined pattern of horizontal Sobel operator outputs, a horizontal filter 
coefficients composition means (14) supplied with said predefined horizontal filter coefficients (F1-F9) for generat- 
ing a set of horizontal filter coefficients (H1-H5) which are a weighted average of the predefined horizontal filter 
coefficients with weight coefficients formed by said degrees of coincidence (a1 -a9). and a horizontal filter (1 5) sup- 
plied with said horizontal filter coefficients (H1-H5) and the vertically-filtered values (Pa. Pb.Px. Pc.Pd) of the pixel 
(Px) and the horizontally-neighboring pixels (Pa,Pb,Pc,Pd) for providing at an ouput (FOUT) said horizontally-fil- 
tered value (Out) of the pixel (Px). 
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